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Abstract 

We consider the ground state of vortices in a rotating Bose-Einstein condensate that is loaded in 
a co-rotating two-dimensional optical lattice. Due to the competition between vortex interactions 
and their potential energy, the vortices arrange themselves in various patterns, depending on the 
strength of the optical potential and the vortex density. We outline a method to determine the 
phase diagram for arbitrary vortex filling factor. Using this method, we discuss several filling 
factors explicitly. For increasing strength of the optical lattice, the system exhibits a transition 
from the unpinned hexagonal lattice to a lattice structure where all the vortices are pinned by 
the optical lattice. The geometry of this fully-pinned vortex lattice depends on the filling factor 
and is either square or triangular. For some filling factors there is an intermediate half-pinned 
phase where only half of the vortices is pinned. We also consider the case of a two-component 
Bose-Einstein condensate, where the possible coexistence of the above-mentioned phases further 
enriches the phase diagram. In addition, we calculate the dispersion of the low-lying collective 
modes of the vortex lattice and find that, depending on the structure of the ground state, they 
can be gapped or gapless. Moreover, in the half-pinned and fully-pinned phase, the collective 
mode dispersion is anisotropic. Possible experiments to probe the collective mode spectrum, and 
in particular the gap, are suggested. 
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I. INTRODUCTION 

It has been known since the work of Onsager [l| and Feynman P] that a super- 
fluid supports angular momentum only through quantized vortices. Furthermore, follow- 
ing Abrikosov's prediction that vortices in type-II superconductors arrange themselves on a 
lattice and its experimental confirmation 0, ^, Tkachenko showed that vortex^lines in 



a rotating superfluid form a regular hexagonal lattice in the absence of disorder M. Such 

p n 

an Abrikosov lattice, as it is nowadays called, was indeed observed experimentally [7|, |8[. 
Tkachenko also predicted the vortex lattices to support phonons, the so-called Tkachenko 
modes 0|. 

With the first experimental realization of Bose- Einstein condensation in ultracold dilute 
atomic gases Q], another regime in the physics of neutral superfiuids has become accessible, 
i.e., the weakly-interacting regime. Following this achievement, the same group created, for 
the first time, a vortex in an atomic Bose-Einstein condensate Although there has 

been some experimental interest in the equilibrium and nonequilibrium behavior of a single 



vortex line ll^ 



IJ], since the observation of a Bose-Einstein condensate with more than 



one vortex uM, however, most of the experimental studies are focused on vortex lattices 

~inn 

161 1171 118| . In particular, the dependence of the lowest Tkanchenko mode on the rotation 
frequency has been measured and is theoretically well understood [2^. 

One aspect that distinguishes the physics of vortices in atomic Bose-Einstein condensates 
from superfluid Helium and superconductors, is that in the latter systems the pinnin g of 



vortices due to intrinsic disorder in the system plays an important role 
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This, together with the discovery of high-temperature superconductors, has led 
;o man y th eoretical studies of the effects of pinning on the melting of the vortex lattice 
28. 129! Is^ Isit. Furthermore, in the context of type-II superconductivity, there has been a 
lot of interest in the effects of a periodic array of pinning centers on the ground state of the 
vortices In particular, it turns out that, due to the competition between 

vortex interactions and pinning, the system exhibits a rich ground state phase diagram, as 
a function of the vortex density and the strength of the pinning potential js^. However, 
since the pinning potential in the case of vortices in type-II superconductors is known only 
phenomenologically, a detailed comparison between theory and experiment seems unfeasible. 
Very recently, we have shown that a rotating Bose-Einstein condensate in a so-called 
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optical lattice is a very attractive system to study the pinning of vortex lattices in a superfluid 
37[. Such an optical lattice is formed by laser fields that trap the atoms using the dipole 
force. Recently, the experimental control over the strength of the optical lattice enabled 
Greiner et al. 1.3 8»1 to experimentally explore the Mott-lnsulator to superfluid quantum 
phase transition J33, Q|- rotating the optical lattice at the same frequency of rotation 
as the Bose-Einstein condensate, the vortices experience a static pinning potential that is 



determined by the optical lattice j37|, |41|, . Such a co-rotating optica. 
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lattice can be 
. Since the 



made by rotating holographic phase plates or amplitude masks j4 
strength of the optical lattice determines the strength of the pinning potential, and the 
rotation frequency controls the density of vortices, the phase diagram can be studied in 
detail experimentally. 

In Ref. [37 1 we have calculated the phase diagram for a homogenous Bose-Einstein conden- 
sate with one vortex per unit cell of the optical lattice analytically, by means of a variational 
method. It is the aim of this paper to extend these calculations to other vortex filling fac- 
tors and to the situation of a two-component Bose-Einstein condensate. Furthermore, we 
also study the collective modes of the pinned and unpinned vortex lattices. Complementary 
to our analytical work, Pu et al. numerically studied a Bose-Einstein condensate in a 
co-rotating optical lattice with an additional harmonic confining potential. The harmonic 
trapping potential leads to finite-size effects which further enrich the phase diagram of the 
system. Unfortunately, including an additional harmonic potential in our variational calcu- 
lations makes analytical results unfeasible. Therefore, we consider the homogeneous case, 
which brings out the physics of the competition between vortex interactions and pinning po- 
tential most clearly. In Ref. 3^ we studied both the case of a one-dimensional optical lattice 
and the two-dimensional case. In this paper we focus on the two-dimensional situation. 

The paper is organized as follows. In Sec. |n]we derive the pinning potential and vortex 
interaction energy. Using these results, we calculate in Sec. IIIII the energy of an arbitrary 
vortex lattice in a periodic potential. This result is used to determine the ground state 
phase diagram in Sec. II VI for a single-component Bose-Einstein condensate for various filling 
factors. The two-component case is discussed in Sec. El In Sec. IVII we determine the 
dispersion of the low-lying collective modes over the ground state. We end in Sec. IVIII with 
our conclusions. 
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II. VORTEX INTERACTIONS AND POTENTIAL ENERGY 



In this section we calculate the interaction energy of two vortices, as well as the potential 
energy of a vortex in the optical lattice, i.e., the pinning potential, by means of a variational 
ansatz. These results are needed later on to determine the phase diagram. 



A. Pinning potential 

Since we assume the system to be at zero temperature throughout the paper, the most 
convenient starting point is the hamiltonian functional which gives the total energy of the 
system in terms of the macroscopic condensate wave function ^^(x), and reads 

H[^\^ = y'dxM/*(x)[-^ + i^|vI/(x)p + K)L(x)-/.]vI/(x). (1) 

Here, M denotes the mass of one atom which interacts with the other atoms via a two-body 
contact interaction of strength g = Anagh'^/M, with > the s-wave scattering length. 
The two-dimensional optical lattice potential is given by 

Vol(x) = sE^ [sm\qx) + sm\qy)] , (2) 

with Eji the recoil energy, q the wavenumber of the optical lattice, and s > a dimensionless 
number indicating the strength of the optical lattice. The chemical potential that fixes the 
number of atoms in the condensate is given by fi. 

Throughout this paper we consider for simplicity a condensate with infinite extent in the 
x-y-plane which is tightly confined in the z-direction by an harmonic trap with frequency 
Uz- This approach is motivated by the fact that a Bose-Einstein condensate that is rotated 
around the z-axis will extend in the x-y-plane due to the centrifugal force. Assuming that 
modes in the z-direction are frozen out, such that the wave function is gaussian in this 



direction, effectively leads to a condensate thickness = a/ irh/ (Mcj^). These assumptions 
allow us to neglect the curvature of the vortex lines along the z-direction. Note also that we 
can safely omit the term proportional to the external rotation frequency in Eq. (^, since we 
intend to work with a variational ansatz which has a fixed vortex density, and, moreover, we 
assume that the harmonic magnetic trapping potential approximately cancels the centrifugal 
force. 
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We consider the system in the Thomas-Fermi hmit where the kinetic energy of the con- 
densate atoms is neglected with respect to their potential energy and mean-field interaction 
energy. Minimizing the hamiltonian of Eq. (^Q) in this limit, the global density profile of the 
condensate without vortices is given by 



with n = [ji — sE^I g the average density of the condensate. 

As already mentioned, to find the potential energy of a vortex in a Bose-Einstein con- 
densate in an optical lattice, as a function of its coordinates {ux,Uy), we use a variational 
ansatz for the condensate wave function. It is given by 



with C, = l/y/Sim^ the healing length that sets the size of the vortex core, (/)(x, u) = 
arctan[(?/ — Uy)/{x — u^)] the phase configuration corresponding to one vortex, and Q{z) 
the unit step function. For the above ansatz to be a good approximation, we have assumed 
that the vortex core is much smaller then an optical lattice period, g.^ <^ 1, and that the 
strength of the potential is sufficiently weak, sE^i < ji. The use of a unit step function for 
the density profile of the vortices is justified because the main contribution to the energy of 
the vortices is due to the superfiuid velocity pattern and not due to the inhomogeneity of 
the condensate density Q|. 

Substituting the ansatz in Eq. (j3)) in the hamiltonian in Eq. and integrating over 
the entire x-y-plane gives the total energy of the vortex in the optical lattice. This energy 
diverges with the system size. However, we need to isolate the finite, position dependent 
contribution to the energy due to the presence of the vortex, which is the only relevant 
contribution for our purposes. 

There are two position dependent terms which contribute significantly to the energy. The 
first one is largest and is entirely due to the kinetic energy of the condensate. Neglecting 
the effect of the laplacian on the global density profile, which is consistent with the Thomas- 
Fermi limit, we have 



nTF(x) = |^(x)|' 



n - [VbL(x) - sE^\/g , 



(3) 




(4) 
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The integral can be done by shifting the integration variables to x = pcos6 + Ux and 
y = psinO + Uy. A little algebra yields 

U^m{ux,Uy) = — - [cos{2qUx) + cos{2qUy)] / d6 — cos{2qpcos6) 
o«s Jo J( 2p 



f /"°° dp 

[sin(2giia;) + sin(2gMj^)] / d6 —sm{2qpsm6) . (6) 

Jo Ji 2p 



Sa^ 

When integrated over polar angle, the second part on the righthand side of this expression 
gives zero. The integral in the remaining part can be further simplyfied by using a Jacobi 
expansion and integrating out the polar angle 

E (-1)" r ^■J^n{2qp) r dOe'^-' = n r ^M2pq) ^ ttQUqO , (7) 

where J/ is the l-th orther Bessel function of the first kind. 

The second vortex position dependent contribution to the energy comes solely from the 
core. Let us consider the energy contribution 



U = d, d^x'^*U) 



K)l(x) + ||^(x)|2-/.]v1/(x) . (8) 

Alternatively, this term is written as U = — f/core(u), where E^^ is a divergent constant 
equal to the energy of the condensate without a vortex and f/corc(u) the contribution of the 
region excluded by the core of the vortex. Since the latter depends on the vortex coordinates 
this contribution must be taken into account which gives 



f^core(u) 



-4 / d'^x |nTF(x)nTF(x) + {Vol{^ - u) - /i)nTF(x) 

J core 

^ f d^x[p - VbL(x - u)]^ 

"^9 J cove 

j d^xVoLi^ - u) + Ois^El) . (9) 

J core 



dzP 
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Performing the integral on a disk with radius ^ we arrive at the same form as in Eq. 
The only difference is the prefactor, which depends on g^, 

Qcore(gO = . (10) 

Consistent with our previous remarks, this contribution of the vortex core to the position 
dependent energy is smaller than the kinetic energy contribution. It adds to the latter 
contribution given in Eq. ^ and hence we define Q = Qkin + Qcore- Putting things together, 



the potential energy of a vortex described by the ansatz of Eq. (0} in a two dimensional 
optical lattice is given by 6^ 

f/pin(u) = -^sERQ{q^)[cos{2qu^) + cos{2qUy)] . (11) 

It is clearly seen that the potential energy is minimal if the vortices are located at the 
maxima of the optical potential. This is expected, since at these maxima the condensate 
density, and hence the kinetic energy associated with the superfluid motion, is minimal. 
The expression in Eq. is regarded as a pinning potential experienced by vortices in a 
condensate loaded in a optical lattice. 



B. Vortex interactions 



The interaction energy of two vortices must be known explicitly to calculate the ground 
state structure of vortex lattices. We calculate this interaction energy by using the following 
ansatz for the condensate wave function 

^(x) = 6(7? - |x|) 0[|x - u|/^ - 1] 0[|x + u|/^ - 1] cxp[i0(x, u) + i0(x, -u)] . (12) 

This form is a generalization of the ansatz in Eq. Q to the case of two vortices in a 
disk-shaped condensate with radius R and average density n, oppositely displaced over 
a distance |u| from the origin. The reason that we do not explicitly take into account the 
spatial inhomogeneity of the condensate density due to the optical lattice potential in the 
calculation of the vortex interaction energy, is that most of the vortices in the vortex lattice 
are separated by more than one optical lattice constant, such that the effect of a spatially 
varying density profile on the vortex interactions is averaged out. In the relevant limit where 
the healing length is small compared to the system size, the only significant contribution 
comes from the kinetic energy of the condensate. For simplicity we place the vortices along 
the X-axis, {ux,Uy) = (|,0), which leads for the energy of the system to 

^^'^ = W/o ^Vo ^^^^ + 16/-8rVcos2^ 

= 1287r^^^ rdpp ^l_sgn(4p2 _ r^) . (13) 

Here p is the radial coordinate and 6 is the polar angle. The effect of the condensate density 
profile is incorporated by simply excluding the contribution of the vortex cores from the 
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expression in Eq. (fT^ such that 
64:TTffd-,n 



V{r) 



M 



dpp 



+ 



R 



dpp 



(^■+0/2 



M R 



hm log 



1^:2 



f4(16i?4 



f4) 



(14) 



where we defined R = R/^ and r = r/^ and also took the limit R ^ oo. The latter result 
is divergent with increasing system size. The finite, interaction energy of the two vortex 



configuration is isolated by subtracting the divergent constant 



TTh?dz 



lim^_^^ log[l/i?^] from 



the expression in Eq. (jl4|) and evaluating the limit R ^ oo. The resulting expression does 
not depend on the system size and behaves like 

2'n-ffdyn 



V{r) 



log 



(15) 



M ° 

for r ^ ^. This is the well-known long range interaction potential experienced by singly 
quantized vortices in two dimensions |42|. 

In the next section we will use the results for the vortex pinning potential and the vortex 
interaction energy to calculate the energy of a lattice of vortices. 



III. ENERGY OF A VORTEX LATTICE IN A PERIODIC POTENTIAL 



In principle, to calculate the equilibrium positions of the vortices, we have to minimize 
the total energy as a function of the coordinates of the vortices. Clearly, for a large number 
of vortices this is unfeasible. It is known, however, that in the limit of strong pinning, the 



vortices form regular lattices j3z 
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Is^. Therefore, to find the phase diagram of 
the system, we minimize the energy of the system assuming that the vortices form a regular 
lattice. This procedure neglects the fact that for small pinning potential the hexagonal 
Abrikosov vortex lattice is slightly distorted by the pinning potential 36 1. 

To carry out the above minimization procedure, it is easiest to parameterize a unit cell 
of the vortex lattice for a given filling factor u. The filling factor is defined as the number of 
vortices per pinning center, i.e., per minima of the pinning potential. In terms of the density 
of vortices it is equal to = n^a^, where is the two-dimensional density of vortices that 
is set by the rotation frequency Q as Uy = MQ/^jrh) and a = vr/g is the optical lattice 
constant. 
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We consider commensurate filling factors smaller than one, i.e, z/ = with k a positive 
integer. All possible vortex lattice unit cells corresponding to such commensurate vortex 
lattices at a particular filling factor can be found by factorizing k in products I ■ m, with / 
and m positive integers, and arranging vortices on the sides of rectangles of size la x ma, as 
shown in Fig. ^ Varying the vortex positions along the sides of the rectangle, keeping the 
area of the unit cell constant, gives all possible primitive commensurate lattice structures 
for the vortex lattice. For a vortex lattice of filling u this procedure is parameterized by 









I muy I 



u[a,p ; l,m) = a | | | | , [lb) 

f3m v^l + al(3m 

with rii & Z and < a, (3 < ^. Notice that the transformation matrix in the above expression 
preserves the area of the unit cell, since its determinant equals unity. This ensures that we are 
considering lattice configurations with equal vortex density. The more familiar parameters 
of a unit cell of a two-dimensional lattice, the angle between the primitive lattice vectors 
and the ratio of their lengths, k = L1/L2, are related to a and (3 by 



COSV9 m(Q;/ + (3■m)^yl + al(3m 

(17) 



K l[l + (3m{al + 13m)] 

sinip m 



K l[l + I3m{al + (3m)] 

The interaction energy i^int per unit cell as function of if and k, for an infinite two- 
dimensional lattice of vortices subject to the logarithmic interaction potential of Eq. ()15|) 
was calculated by Campbell et al. [50]. Cast in a dimensionless form their result reads 



p - -^int _ TT sin 



2ti 



( sin 



V ^ 

-log{nf=i[l - 2e-2-^>^'^^l/''cos (2vri^) 

^ g-4^i|sm^|Aj| _ (18) 

It is important to realize that the interaction energy per vortex is divergent for an infinite 
vortex lattice, and that the above expression gives the relative interaction energy for config- 
urations with equal vortex density. The absolute minimum of the dimensionless interaction 
energy in Eq. (fTH|) corresponds to a hexagonal vortex lattice structure, i.e., the Abrikosov 



vortex lattice with I = m = \fk and al = jdm = y l/y^ — 1/2 or {(f,K,) = (vr/S, 1), and is 
equal to E^^t = —1.32112. Note that this lattice is incommensurate with the optical lattice. 



a 



aalm 



ma 




a(3ml 



la 



FIG. 1: Two ways to parametrize the unit cell of a vortex lattice, using parameters {al,l3m) and 
k), with K = L1/L2. The relation between those parametrizations is given by the expressions 
in Eq. (|17|). The grid indicates the pinning potential with lattice constant a. 

The pinning energy per unit cell is found by substituting Eq. ()16p in Eq. PH) . summing 
over all and Uy, and dividing the result by the number of unit cells, 



This form of the pinning energy per unit cell is what we expect on an infinite lattice. Only if 
the vortices form a lattice that is commensurate with the optical lattice, they give a nonzero 
contribution to the pinning energy. This is why we consider only commensurate fillings, 
since we expect structural transitions at these fillings. Incommensurate vortex lattices have 
zero potential energy per unit cell on average. For z/ < 1 there are three possible outcomes 
for the pinning energy in Eq. ()19p . i) A phase in which all the vortices are pinned by optical 
lattice maxima at E^^^ = —^sEjiQ{qC,), ii) a phase in which a half of the vortices is pinned 
at -Epin = —-^^sEYiQ^qi), and iii) an unpinned phase at i?pin = for any vortex lattice that 
is incommensurate with the optical lattice. The precise geometry of the unit cell of these 
vortex lattices is determined further by minimization of the interaction energy in Eq. ()18p. 
Of course, the structure of the unpinned phase is always hexagonal, corresponding to the 




=-Pny=-P 



8as 



sE^Q{q^)[Sf3rn& + Saiez] ■ 



(19) 
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global minimum of the interaction energy. 

To end this section, we would like to point out that, since the interaction energy of 
the vortex lattice is derived by summing the expression for the interaction energy of two 
vortices over all pairs of vortices, we have implicitly assumed that the vortex density is 
so low that the vortex cores never overlap, and that we are therefore allowed to neglect 
three-vortex interactions, and interactions of higher order. A similar argument validates 
the derivation of the pinning energy of the vortex lattice by summing the single-vortex 
pinning potential over the number of vortices. In the numerical calculations of Pu et al. 
47| . these authors observed that for filling larger than one the vortices form pinned phases 
where pairs of vortices are pinned, and hence two vortices get very close together. Since our 
approximations break down in this case, we study only phases with a filling factor smaller 
than one. 



IV. PHASE DIAGRAMS 



The energy per unit cell of the vortex lattice, obtained by adding the pinning energy of 
Eq. (fTUj) and the interaction energy of Eq. (fTH|) . enables us to calculate the zero-temperature 
phase diagram of the vortex lattice structure at a certain filling. As already mentioned, we 
consider systems with filling factor ^ = \ with k a nonnegative integer larger than one. 

The dimensionless energy per unit cell of the vortex lattice reads 

^^^'^ ' ^'"^'^ =-Eint(a,/? ; - ]^^^Q{qi)[5pm& + 5al(il\ , (20) 

where we used that fi ~ gn. It is most convenient to minimize this expression in the plane 
spanned by the dimensionless parameters and This leads to the three phases dis- 
cussed in the previous section. However, the presence of the half-pinned vortex configuration 
depends on the filling factor, implying different phase diagrams for even and odd k. Since 
the structure of the lattice does not change continuously, the phases are separated by a 
first-order transition. 

In the case of even k, the half-pinned lattice is absent, since the pinning centers are 
distributed such that the minimum energy configuration is always a fully-pinned lattice. 
The phase diagram thus contains two distinct phases: a fully-pinned vortex lattice and the 
hexagonal Abrikosov lattice. The geometry of the fully-pinned vortex lattice is determined 
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such that the interaction energy is minimal j32 , 
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34 
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If k is an odd integer, the half-pinned lattice is present in the phase diagram if the pinning 
energy and the interaction energy are of the same order. However, this phase exists only if 
the inter-vortex distance and the optical lattice constant are comparable in size. 

In Ref. js?! we discussed the case of one vortex per optical lattice unit cell, i.e., u = 1. 
We now discuss three distinct examples in detail. The results are summarized in Fig. |21 



A. i. = i 

For = I the phase diagram contains two phases and is depicted in Fig. |21(a). For weak 
pinning the vortices are not pinned and form a hexagonal Abrikosov lattice. For strong 
pinning all vortices are located on the minimum of the pinning potential, and form a square 
lattice with {a, (3) = (0, |) and {l,m) = (1,2). Note that, as opposed to the u = 1 case jsTj, 
which also has a square and pinned vortex lattice in the strong pinning regime, in this case 
the vortex lattice is rotated over an angle | with respect to the optical lattice. 



B. 1^ = 1 

If there are four pinning centers per vortex, corresponding to = 4, we find for large 
strength of the optical lattice a fully-pinned triangular vortex lattice [63] with {a, (3) = 
(0, |), / = 2 and m = 2. The interaction energy per unit cell of the vortex lattice of this 
configuration is Ei^t = —1.31849. At small optical lattice strength we find the hexagonal 
Abrikosov vortex lattice. The phase boundary is given by 

'sEr\ 0.01057 



(21) 

J hexagonal-pinned 

It is important to note that, contrary to the case of = | and v = \ j^, the geometry of the 
fully-pinned vortex lattice is in this case triangular. Since a fully-pinned square lattice has 
the same pinning energy as this triangular lattice, the interaction energy favors the latter. 
The phase diagram for this filling is shown in Fig. |21 (b). 
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FIG. 2: Vortex phase diagram of a Bose-Einstein condensate in a two dimensional optical square 
lattice, for three different filling factors, s) v = h) v = \, and v = ^. For a weak pinning 
potential the vortex lattice structure is always the hexagonal Abrikosov lattice (AB). The insets 
indicate the vortex lattice structure for stronger pinning potential. The black dots indicate the 
vortices, whereas the square grid indicates the pinning potential. 
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C. 1/ = i 

5 



At = 5 we find three phases. The result is depicted in Fig.|21(c). First, for large strength 
of the optical lattice we have a fully-pinned vortex lattice with {a, /3) = (|, 0), / = 5, m = 1 
and interaction energy Ei^^t = —1-31055. At intermediate optical lattice strengths we find a 
half-pinned phase with = (|,0), / = 5 and m = 1. The interaction energy per unit 

cell of this configuration equals Ei^t = —1.31849. At small lattice strength we find again the 
hexagonal Abrikosov vortex lattice. The boundaries between these phases are given by 

fsER\ _ 0.00526 /sEr\ _ 0.01588 ^^2) 

\ / hexagonal/half-pinnod QilO \ J half-pinned/pinned Q{qC) 

Similar to the i' = \ case, we find that the fully-pinned vortex lattice has a square geometry, 
and is now rotated over an angle tan~^ (|) with respect to the optical lattice. Generally, if 
the fully-pinned vortex lattice has a square geometry, then for filling factor z/ = , ^ , with 
ki and k2 integer, the fully-pinned vortex lattice will be rotated over an angle tan~^ 
with respect to the optical lattice. 

Contrary to the above mentioned filling factors, but similar to the z/ = 1 case 1^3], there 
is an intermediate triangular vortex lattice, where half of the vortices is pinned. 



V. PINNING OF VORTICES IN TWO-COMPONENT CONDENSATES 

In this section we study the influence of a two-dimensional optical potential on vortex 
lattices in a mixture of Bose-Einstein condensates of two different species. Our results also 
apply to a Bose-Einstein condensate that consists of two hyperfine components, provided 
the number of atoms in each component is conserved. Along the lines of Sec. IHl Hill and IIVI 
we calculate the ground state phase diagram for two coupled condensates each containing 
a vortex lattice at filling z/j = 1 with the optical potential. Note that the fact that we take 
the filling factor to be the same in both species implies that the masses of both species are 
approximately equal. 

A system of two coupled Bose-Einstein condensates is described by the following hamil- 
tonian 



i=l,2 



.K.l(x)-/.. 
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+ / dx 



(23) 



with gi = Airh tti/Mi and gu = 271 h a^/Mij. Here ai2 is the scattering length between 
unhke species and the reduced mass is given by Mij = MjMj / (Mj + Mj). 



In the absence of the optical potential, Mueller and Ho [SlJ and Kasamatsu et al. |52j | 
theoretically predicted smooth transitions between hexagonal lattices in both components at 



arger interaction. 
5311 ■ However, the 



small (intra species) interactions and interlaced square vortex lattices at 
These square lattices where observed very recently by Schweikhard et al. 
above-mentioned transition is caused by the fact that the interaction energy is minimized if 
the overall density is as smooth as possible. Since we take a step function for the density 
profile of the vortex, this density effect is not included in our calculations. Therefore our 
results only make sense in the regime where this density effect is dominated by the optical 
potential, i.e., in the strong-pinning limit. To ensure this, the requirement Qil^i) ^ 

— must be satisfied. This implies that we must have that Oj ^ 012, since we assumed 
that sEji < Hi. It must be stressed that this is quite restricting as at the present day 
there is no experimental atomic system known which meet these requirements. However, 
one might expect that near an interspecies Feshbach resonance this regime of parameters 
is realizable. Therefore, we study the fully-pinned and half-pinned lattices and the phase 
transition between them. 



A non-rotating two-component condensate phase separates if gi2 > y^^i^ 



. The 

condensates mutually exclude each other, even in the absence of external potentials 3] or 



with rotation |52| • The vortex ground state in the latter case will not be given by a regular 
lattice, in general. In our calculations we restrict ourself to the regime where the system does 
not phase separate. In this regime, the coupling parameters satisfy gi > and (71(72 > du, 
which falls safely within the approximation discussed above. We define the dimensionless 
parameter = 912/9192, for which these criteria imply < < 1- 

Solving the coupled equations for the condensate wave functions, derived from the hamil- 
tonian of Eq. in the Thomas-Fermi approximation, leads to the following density profile 
in component i 

= l +^ I^^^^W . J^. (24) 

9i 1 - X 912 1 - p 

We use the variational ansatz for the condensate wave function containing a vortex in com- 
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ponent i 



n, 



TF 



x) e[|x - u|/^i - 1] exp[z0i(x, u)] 



(25) 



with = I/v^StFo^ and rii = {^i — sEji)/gi. Furthermore, we assume that vortices in 
different components do not interact. As explained before, in particular we neglect the 
effect of the density profile caused by a vortex in one component on the vortices in the other 
component, which, in the absence of an optical potential, leads to the structural transitions 
discussed by Mueller and Ho 5l| and Kasamatsu et al. [52]. Within each component, the 
vortex interactions are logarithmic, as derived in Sec. IIIBI 

The pinning potential which is experienced by the vortex can be calculated along the lines 
of Sec. Ill Al The first contribution, coming from the kinetic energy term of the hamiltonian 
in Eq. (j2Sl), is equal to 



f^km(u) = ^sE^Q],in{q^i)Gi{gi, g2, gi2) [cos(2gu^.) + cos{2qUy)] 



(26) 



with Qkin given by Eq. (0). The difference with the single component case is the appearance 
of the factor 



Gi{gi,g2,gi2) 



9i2 - 9iX 



(27) 



912(1 -X') • 

This factor is completely dependent on the various interaction strengths. The other signifi 
cant (position-dependent) contribution, coming from the vortex core, involves more work. 



^core ( ^) 



-4 



^g^\^i\^ + {Vol - Aii)|^i|' + ^^?i2|^ 



ym-x'r gha-i/x')' 



+2' 



+ 



(/i» - VbL)(/ij - Vol) 
■(7,^712(1 -X2)(l-1/X^) J 
(/^i - Vol) 



2 \9A^-X^) 9i2{l-llx^)J\ 



X 



OLJ (^i - Vol) 



9i X 



29j 



gi{l-x') 9i2{l-l/x') 
d^xVoL{^-n) + 0{s^El) 



(28) 



If we assume that /ij ~ we find a contribution similar to Eq. ()26j) . The prefactor in 
this case is given by Qcotc{(iO which is defined in Eq. (jTUj) . The total pinning potential 
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experienced by a vortex in component i due to the optical lattice is equal to 

^pin(u) = ^■5ER[Qkm(g6) + Qcorciq^i)]Gi{gi, g2, Qit) [cos(2gu^) + cos{2qUy)] . (29) 

This energy is dependent on the ratio of the coupling parameters. The pinning energy is 
minimized on lattice maxima in both components in the regime where it is the dominant 
energy scale. Therefore, vortices in both components tend to be on the same position. 

In order to find the vortex phase diagram we minimize the interaction and pinning energy 
in each component, as in Sec. IIVI We assume (again) /ij ^ fij = /i. This implies ~ = 
^. As mentioned before, we are only interested in lattice types which are fully-pinned or 
half-pinned. The phase boundary between the fully-pinned and half-pinned vortex lattices 
(commensurable with the optical lattice) in each component is given by 

'sEk\ 0.01494 



Ji Q{(iOGi{gi,g2,gi2) ' ^^^^ 

To find all possible lattice types in the two-component system it is most convenient to 
parametrize the coupling parameters by gi = K,gi2sin{'~f) and g2 = ngu cos{'y) . By varying 
7 one scans along an circle segment in the {gi, g2)-plsine. The non-phase separated regime 
in terms of the new parameters is given hy k > \/2 and 7_ < 7 < 7+ with 



7± = arccos 




(31) 



We find that the phase diagram contains four different vortex lattices. In Fig. (jS)) the 
phase diagram and the lattice geometry are displayed for = 0.05 and k = 100. Notice 
that the two-component phase diagram has a straightforward interpretation in terms of 
coexistence of phases found in the single-component case. For strong pinning the vortex 
lattices are both fully pinned. For the filling under consideration {u = 1) the vortices in 
both components therefore form a square lattice. Depending on the relative strength of the 
interaction, determined by the parameter 7, the vortex lattice in one of the components will 
change first to the half-pinned triangular geometry, as one lowers the strength of the optical 
potential. For sufficiently weak pinning potential both vortex lattices assume this structure. 



VI. COLLECTIVE MODES 



In this section we calculate the dispersion of the collective modes of the pinned vortex 
lattices. In principle, this requires the calculation of the energy of the system for small 
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FIG. 3: Vortex phase diagram of a rotating two-component condensate in the presence of an 
optical lattice, at commensurate filling, i^i = I. The phase diagram is plotted as function of the 
dimensionless parameter 7 = arctan(5i/g'2)- Black dots and circles represent vortices in different 
components. The dashed lines represent the pinning potential. We took k = 100 and q$, = 0.05 
which implies Q(0.05) 3.612. 

displacements u(rj) of the vortices from their equilibrium positions = r^^x + Viyy. In first 
instance, the energy of the system is then given by 



E [u] = ^-"-^^^^(g^) ^ {cos [2q{u, + u,{r,))] + cos [2g(r,, + Uyir,))]} 

(32) 



8a, 

Ti + u(rj) - Tj - u{rj) 



M 

We perform a Fourier transform 



where is the number of vortices along the a direction of the vortex lattice, and the 
momentum sum is restricted over values ka — lima.! La, ^^^^ Brillouin zone, where na 

is an integer and Lq, is the size of the vortex lattice in the a direction. Note that throughout 
this section we use Greek symbols to indicate two-dimensional Cartesian components, i.e., 
a, /3 e {x, y). We also sum over repeated Greek indices. 
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We expect that after this Fourier transformation the energy of the vortex lattice for small 
displacements will, up to an irrelevant constant, be given by 

E[n] = i5^D„^(k)M„(-k)M^(k) , (34) 

k 

where the so-called dynamical matrix is the sum of three contributions 

^.^k) = D^J(k) + Dj;J(k) + D^j^ik) . (35) 

The first contribution D^^(k) takes into account the interaction between neighboring vor- 
tices and follows from elasticity theory. Although the elastic constants that will enter in the 
expression for D^^(k) can in principle be calculated from the interaction energy in Eq. (jH^ . 
such a calculation is beyond the scope of this paper, and we will adopt a more phenomeno- 
logical point of view and write down the most general form for D^p{k) allowed by symmetry 



arguments, for each lattice under consideration 



1/3 > 

. The second contribution 



= ^^^T^ . (36) 



where A is the area of the unit cell of the vortex lattice, is independent of the structure 



of the lattice and follows from the long-ran 



has to be taken into account separately 



ge nature of the logarithmic interactions, which 
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59 



60|. Note that we have explicitly included 
a finite range A of the logarithmic interactions, to ensure that D^^ ^ as ^ 0. After 
taking the long wavelength limit, we can safely take A — > 0. The final contribution D°^(k) 
is due to the optical lattice. 

The dispersion of the collective modes is determined by putting the determinant of the 
matrix 

MapiK u) = Dapik) - eap'lTrind^.hw , (37) 
equal to zero. Here, eajs is the antisymmetric Levi-Cevita tensor in two- dimensions, that 



49| 



takes into account the Euler dynamics of the vortices 

We will now calculate the dynamical matrix for each type of vortex lattice considered 
in the previous section, i.e, for the hexagonal, half-pinned, and fully-pinned vortex lattice, 
in the long- wavelength limit, and use these results to calculate the phonon spectrum of the 
vortex lattice. 
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A. Hexagonal vortex lattice 



For a hexagonal vortex lattice we have that j5 



(38) 



where Kh is the bulk modulus, and is the shear modulus of the hexagonal vortex lattice. 
Using this result together with Eq. we find for the frequency of the collective modes in 
the absence of an optical lattice that 

k 



'/in 



alM 



+ {Kh + ^iH) k^ 



(39) 



For large wavelengths we have that /zc^k — cxk, where the sound velocity of the so-called 
Tkachenko waves is given by 



Ct 



(40) 



We could now fix the value for the shear modulus of the vortex lattice fin by demanding 
that the Tkachenko sound velocity is equal to h^l / (AM) , the result known from the hy- 
drodynamic theory of a vortex lattice This would, however, not be consistent, since 

the value for fin should follow from the expression for the energy of the vortex lattice in 
Eq. (jn^j and may lead to a different sound velocity due to the variational approximations we 
have made in the description of the vortex lattice. Note that is crucial to take into account 
the long-range interactions of the vortices by means of the dynamical matrix in Eq. ()36|) to 
get a linear dispersion at long wavelengths, since an omission of this part in the dynamical 
matrix would lead to a quadratic dispersion. Moreover, we would like to point out that due 
to the fact that vortices are described by Euler dynamics we find only one mode, instead of 
two modes for the case of a lattice of particles that obey Newtonian dynamics. 

The polarization of the vortex lattice phonons is determined by the eigenvector of the 
matrix in Eq. ()37p . corresponding to the eigenfrequency in Eq. (jH^ . Generally, the displace- 
ments are given by u(rj,t) = Uk,oe*'' '"'~*'^''*, where Uk,o is the eigenvector. For a wave in the 
^/-direction we have that 



Uk,0 OC 



i 






ky\j 







\ 



(41) 
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which shows that the vortices move on an elhpse with the long axis perpendicular to the 
direction of propagation. In the limit k ^ 0, the wave is almost transverse. 

The translation symmetry of the system is broken explicitly in the presence of an optical 
lattice. The collective modes therefore acquire a gap, i.e., there is a minimum amount of 
energy required to excite a phonon. Considering the part of the energy of Eq. (|32j) which 
corresponds to the pinning energy of the vortices and expanding it, we have, up to an 
irrelevant constant, 

EO^[^] = -2q-^-l2^fMl ^ («.(k)«.(k')$:cos[2gr,Je^(''+'^')-^ 

+ Uy{\,)uy{\^) J2 cos[2gr,,]e^('^+'^')-^ I , (42) 
j ) 

with the positions of vortices in the hexagonal lattice given by 

1 1 

i'ix + ^iy)x + -^VSiyi) . (43) 

Summing over these lattice coordinates in Eq. (jl^ gives zero. This is in contradiction with 
the fact, that on symmetry grounds we expect a finite gap for the collective modes. To 
overcome this problem we must take into account that the real unpinned vort ex g round 
state in a weak periodic pinning potential is a slightly distorted hexagonal lattice [36[. This 
comes about because the periodic potential exerts a small net force on the vortices arranged 
in the hexagonal lattice. The small distortion of the vortex positions is a modulation around 
the equilibrium of the hexagonal lattice + R(ri). Following Pogosov et al. [36] we 

find for a square two-dimensional periodic potential 

Ra{r.) = T^^^QiqO sm[2gr,„] . (44) 
ZqHuA Qtts 

The modulation of the vortex coordinates around the positions of the regular hexagonal 
lattice involves a factor rf = j^^- To keep the displacements small, the condition rj <^ 1 
must be satisfied. 

Summing over the displaced hexagonal vortex lattice in Eq. ()42|) indeed leads to a non- 
zero energy gap. Numerical evaluation of Eq. (jl^ on a large lattice gives a contribution to 
the dynamical matrix which is roughly linear in t], 



^ 0.57] sEn 



4a, 



Jap 



77 < 1 . (45) 
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Including this in the calculation of the collective modes, we find 

2 



0,5, .Eh I ^;^) +,Hk' 



X 



The gap takes the form 



4a, 



(46) 



(47) 



B. Half-pinned vortex lattice 

In the case of the half-pinned vortex lattice, which is always triangular, the dynamical 
matrix that follows from elasticity theory is given by (57l | 

D^p(k) = Krkak/s + urSaisk'^ + kt(1 - Sap)kakf3 + SfiTT^pkak/s , (48) 

where is the bulk modulus of the triangular vortex lattice, and kt and fir denote the 
Lame constants. For a square lattice we have that the parameter SfiT is equal to zero, as we 
will see below. In the above expression r^^ denotes the Pauli matrix. 

To find the contribution due to the optical lattice, we consider specifically the half-pinned 
case at filling i/ = |, as shown in Fig. El We parametrize the equilibrium position of the 
vortices as 

5 [1 — (— l)*""] 
= -ixax + 2 ay + 2iyay . (49) 



With the use of this parametrization we find that the energy of the vortex lattice due to the 
pinning of the optical lattice is, for small displacements u(rj) from the equilibrium positions, 
given by 

?OL r..- 



[u] 



{cos [2q{rix + Mx(ri)) + vr] + cos [2q{riy + Uy{vi)) + tt]} 



d,sEWQ{qO 
4a, 



(50) 



where we have omitted an irrelevant constant. Note that we have translated the optical lat- 
tice potential to ensure that there is a vortex at the origin, consistent with the parametriza- 
tion in Eq. Using that 

Y,^""'"' = N.Ny5^^o , (51) 
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we find after a Fourier transform in first instance tliat 



[u] 



4a., 



i k' 



(52) 



Tlie sum in tfie second term of this equation is evaluated by splitting it into a sum over 
ix even and ix odd. If we denote k + k' = {27Tnx/Lx, 2iTny/Ly), we have that 



i^+lgi(k+k')-ri 



i-(-i)'- 



E 



27rm^(2p)/Af^ _ ^ ^2™^ (2p+l)/Ar^ -Trmy/ATy 



-NxSn^nNySn 



"'^ \ 2iTinx/Nx—'!riny/Ny 



2 2 



(53) 



With the use of this result we have that 

I 
4a 



^OL ^ J]«^(k)«,(-k) ^ 1 J]DO,^(k)«.(k)«,(-k) , (54) 

so that the contribution to the dynamical matrix due to the optical lattice is given by [3] 

(55) 



D^p (k) = — do,,yda^ 



2as 

With the above results, we find that the collective mode dispersion is given by 



2 .-2 ; 4 I 2 I 2 / ; 2 Sir'^H'^d^n 



1 
4 

4si?Rg'Q(gO 



- -,¥lklkl + firSfirk^kl - k^) 



— Kt 



IQix^frdzU 



+ {2Kt + /«t)A;' 



+ 



2a, 



7 2 / , ^^^T . STi'^h^d.n , 2 



(56) 



Interestingly, this dispersion is gapless, i.e., huo = 0. The eigenvector corresponding to this 
eigenfrequency is given by (1,0), and so the displacement of the vortices is along the x-axis. 
Physically, this is understood because it does not cost any energy to uniformly displace all 
the vortices in the x-direction when the vortices are forming a half-pinned lattice with the 
geometry shown in Fig. |21 (See again and Q ) 

This comes about because under a 
uniform translation of the vortices in the x-direction, half of the vortices move away from 
an energy minimum and therefore increase their energy, the other half moves downhill from 
an energy saddle-point, precisely compensating this increase. 
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C. Fully-pinned vortex lattice 



The structure of the fully pinned vortex lattice at certain filling is triangular, in general. 
Therefore, the contribution to the dynamical matrix due to the elasticity of the vortex lattice 
takes the form of Eq. (jiH|) with elastic constants Kp, , np and 6fip. In the special cases 
for which the fully pinned vortex lattice has a square structure, we have that 6fip = 0. Since 
all the vortices are positioned at the minimum of the pinning potential, the contribution of 
the optical lattice to the dynamical matrix is constant and diagonal, and given by 



2ao 



(57) 



Hence, we find for the phonon dispersion 



2a. 



+ 



4u 



2kp Kp 



k^ky 



(58) 



At zero momentum we find for the gap |71l 



qhEnQiqO 



(59) 



corresponding to an eigenvector oc From this eigenvector we therefore conclude that 

the zero-momentum mode physically corresponds to a precession of the vortices around the 
maxima of the optical lattice potential, as expected. 



D. The gap 



If one tunes the strength of the periodic potential, the vortex lattice changes, depending 
on the filling u. The energy gap of the collective modes is different in the three vortex lattice 
phases. To summarize the results on the gap, we have 



hujQ 



0.5 T] ^[qC^Q^q^)]"^ sE^ hexagonal vortex lattice, 
half-pinned vortex lattice, 

{qC)'^Q{qOsEji/T: fully-pinned vortex lattice. 



(60) 
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FIG. 4: The energy gap to the collective modes of a vortex lattice in the presence of a periodic 
optical potential as function of the lattice strength, for i' = \ (open circles) and u = ^ (filled 
circles). We used rj = 0.64 (^) (see Q) and = .05. 



It is clear that the gap in the hexagonal phase is much smaller than the gap in the fully- 
pinned vortex phase. This is because in the hexagonal phase, the non-zero contribution 
comes entirely from the displacements of the vortices from the equilibrium positions of the 
hexagonal lattice. The gap is then of second order in sEji, since t] oc sE-r. 

For the half-pinned and fully-pinned vortex lattices, there is no second order contribution 
to the gap. This is because in these phases the vortices are located on minima and saddle 
points of the pinning potential. The fact that the energy gap in the half-pinned phases is 
zero, relies on the fact that we consider infinite vortex lattices. In a trapped system there 
will be a gap to collective excitations, that becomes smaller with increasing system size. 

In Fig. we display the gap as function of the dimensionless parameter for the 
cases = \ and = \ which we have considered in this paper. It is clearly seen that the 
gap has a discontinuity if is tuned through a phase boundary. It must be emphasized 
that in the Abrikosov phase only the qualitative features of the behavior of the gap can be 
deduced from Fig. (jlj). This is because the gap then depends on the shear modulus 
which is a phenomenological constant in our calculations. 
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Finally, we would like to comment on the experimental implications of the collective mode 
spectra we have calculated. Although our calculations contain phenomenological parame- 
ters, there are nonetheless some qualitative predictions that could be tested experimentally. 
First of all, for the half-pinned and fully-pinned vortex lattices the collective mode spec- 
trum is anisotropic, i.e., the frequency of the collective modes depends on the direction of 
propagation. By performing the same experiment as Coddington et al. jl^, in which the 
collective modes are excited by a perturbation at the center of the condensate, one could 
probe this anisotropy. Another prediction of our theory is that the collective modes are in 
general gapped in the presence of the vortex lattice. An exception is the triangular half- 
pinned vortex lattice, which has a gapless mode, corresponding to the translation of the 
vortices in one direction. (For the illustration in Fig. |21 this direction is the x-direction.) 
For the propagation of the modes in the other direction there will be a gap. This strong 
anisotropy should be experimentally observable by the above-mentioned experiment. The 
excitations of the fully-pinned vortex lattice are also gapped. As mentioned before, the zero- 
momentum mode corresponds in this case to a simultaneous in-phase precession of all the 
vortices around the maxima of the optical potential. This mode could be excited by slightly 
displacing the optical lattice. Because this zero-momentum mode of the vortex lattice does 
not have shear or compression, it does not depend on the elasticity constants, which are 
phenomenological in our calculation. Hence Eq. ()60|) should give an accurate prediction for 
the gap in this case, which is directly experimentally verifiable. 



VII. CONCLUSIONS 



In this paper, we have presented a method to determine the ground state phase diagram 
of vortices in a Bose-Einstein condensate in an optical lattice, thereby extending previous 
work 0] to an arbitrary number of vortices per unit cell of the optical lattice, the so-called 
filling factor. The vortices arrange themselves in various patterns, depending filling factor 
and the optical lattice strength. Generally, we find three vortex phases, i) a fully-pinned 
phase in which each vortex is pinned to a maximum of the periodic potential, ii) a phase 
in which half of the vortices are pinned to maxima of the optical lattice and in) a phase in 
which none of the vortices are pinned, and the structure of the vortex lattice is determined 
by the interactions. The structure of the unpinned phase is always hexagonal, whereas the 
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structure of the half-pinned phase is triangular. We have discussed several distinct filling 
factors explicitly, to demonstrate the above generic features. We calculated the dispersion 
of low-lying phonon modes of the vortex lattice for each of these phases. In the case of 
the half-pinned and fully-pinned vortex lattice we find that the collective mode spectrum is 
anisotropic. Furthermore, in the unpinned and fully-pinned phase the collective modes are 
gapped. Both features should be observable experimentally, and we have outlined possible 
experiments to probe the collective modes. 

There are several interesting directions for further investigation of the infiuence of a 
periodic potential on the physics of rotating Bose-Einstein condensates. For instance, it 
would be interesting to consider more strongly-correlated regimes that occur at fast rotation 
6^ . and to study the effects of the periodic optical potential on the melting of the vortex 
lattice jo^. One would expect that in this regime the effect of quantum fluctuations, i.e., 
quantum tunnelling of the vortices through the potential barriers of the pinning potential, 
becomes important. Aspects of this were studied by S0rensen et al. [63], who showed that 
for ultra low particle and vortex density the ground state of rotating bosons in a periodic 
potential is a Laughlin liquid. It would be challenging to investigate the system with high 
particle and vortex density and a large number of vortices per boson. 

Yet another interesting possibility for future work is to study a rotating spinor condensate 
in the presence of a period ic p otential. Rotating spinor condensates are expected to form 
spin-textures (skyrmions) 0, and regular lattices thereof 0, 0], analogous to the 
formation of vortices in a single component condensate. The pinning effects in each spin 
component of the condensate caused by the periodic potential will further enrich the phase 
diagram in these systems. 

We would like to thank M. Hafezi, R. Hagemans, F.J.M. van Lankvelt, A.H. MacDonald, 
P. Pedri, V. Schweikhard, K. Schoutens, and H.T.C. Stoof for useful discussions. This 
research was supported by the National Science Foundation under grant DMR-0 115947 
(R.A.D.) and by the Netherlands Organization for Scientiflc Research, NWO (J.W.R.). 
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